Electronic device and method of controlling the same

ABSTRACT

An electronic device connected to at least one external electronic device, the electronic device including a communication unit configured to perform data communication with the at least one external electronic device, an interface unit configured to connect to a sound output device, and a controller configured to receive audio data when the sound output device is connected to the electronic device through the interface unit, the audio data associated with a first external electronic device outputting a second content associated with a first content being output through the electronic device from the first external electronic device, and to output the received audio data through the sound output device.

CROSS REFERENCE TO RELATED APPLICATIONS

This nonprovisional application is a Continuation of co-pending U.S.patent application Ser. No. 13/462,530 filed on May 2, 2012, whichclaims the benefit of priority to U.S. Provisional Application No.61/606,475 filed on Mar. 5, 2012. The entire contents of the aboveapplications are hereby incorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of Invention

Embodiments of the present invention are directed to an electronicdevice connected to at least one other electronic device, which allows auser to easily notice audio data generated from the electronic deviceand the other electronic device and a method of controlling theelectronic device.

2. Discussion of the Related Art

The advancement of hardware and software technologies and combination ofnetworks enable various communications between electronic devices whilediversifying the use of the electronic devices.

Accordingly, a need exists for a more user-friendly user interface (UI)for electronic devices that may perform communication with externalelectronic devices. Also, various methods are needed to allow a user toefficiently control an electronic device so that he/she can enjoyvarious contents through multiple electronic devices (for example,3-screen play or 5-screen play).

SUMMARY OF THE INVENTION

Embodiments of the present invention provide an electronic device thatcan more efficiently output audio data generated from multipleelectronic devices connected to one another to a user and a method ofcontrolling the electronic device.

According to an embodiment, there is provided an electronic deviceconnected to at least one external electronic device, the electronicdevice including a communication unit configured to perform datacommunication with the at least one external electronic device, aninterface unit configured to connect to a sound output device, and acontroller configured, when the sound output device is connected to theelectronic device through the interface unit, to receive audio dataassociated with a first electronic device outputting a second contentassociated with a first content being output through the electronicdevice from the first electronic device and to output the received audiodata through the sound output device.

The controller is configured, when the sound output device is connectedto the electronic device, to transmit a first message to the firstelectronic device, the first message indicating the connection of thesound output device.

The controller is configured to determine the first electronic deviceoutputting the second content among the at least one external electronicdevice.

The controller is configured to, among the at least one externalelectronic device, determine an electronic device streaming the firstcontent to the electronic device as the first electronic device.

The controller is configured to, among the at least one externalelectronic device, determine an electronic device providing accessinformation for accessing the first content as the first electronicdevice.

The controller is configured to transmit a second message to the atleast one external electronic device, wherein the second messageincludes information on the first content, and wherein the controller isconfigured, when receiving a response message in response to the secondmessage, to determine an electronic device transmitting the responsemessage as the first electronic device.

The first content includes metadata for the second content.

The received audio data includes encoded audio data.

The controller is configured, when the output of the first contentassociated with the second content is stopped, to continue to receivethe audio data associated with the first electronic device and to outputthe received audio data through the sound output device.

The controller is configured, when the output of the first contentassociated with the second content is stopped, to provide a userinterface to determine whether to continue to receive the audio dataassociated with the first electronic device.

According to an embodiment, there is provided an electronic deviceconnected to at least one external electronic device, the electronicdevice including a communication unit configured to perform datacommunication with the at least one external electronic device, a soundoutput module, and a controller configured to transmit audio datacorresponding to a first content to a first electronic device outputtinga second content associated with the first content among the at leastone external electronic device through the communication unit whensensing a connection of a sound output device to the first electronicdevice while outputting the audio data through the sound output module.

The controller is configured to stream the second content to the firstelectronic device through the communication unit.

The controller is configured to transmit access information foraccessing the second content to the first electronic device through thecommunication unit.

The transmitted audio data includes encoded audio data.

The controller is configured to stop outputting the audio data whentransmitting the audio data to the first electronic device.

The controller is configured to display an indicator through a displaymodule to indicate that the audio data is transmitted to the firstelectronic device when transmitting the audio data to the firstelectronic device.

According to an embodiment, there is provided a method of controlling anelectronic device connected to at least one external electronic device,the method including sensing a connection of a sound output device tothe electronic device, receiving audio data associated with a firstelectronic device outputting a second content associated with a firstcontent being output by the electronic device from the first electronicdevice when the sound output device is connected to the electronicdevice, and outputting the received audio data through the sound outputdevice.

The method further includes identifying the first electronic deviceamong the at least one external electronic device.

Identifying the first electronic device includes determining as thefirst electronic device an electronic device streaming the first contentto the electronic device among the at least one external electronicdevice.

Identifying the first electronic device includes determining as thefirst electronic device an electronic device providing accessinformation for accessing the first content among the at least oneexternal electronic device.

The first content includes metadata for the second content.

The received audio data includes encoded audio data.

The embodiments of the present invention provide the following effects.

A user who simultaneously uses a plurality of electronic devices (forexample, smartphone and TV) may easily obtain the audio data associatedwith the plurality of electronic devices through a sound output device(e.g., earphone) connected to one electronic device (e.g., smartphone).

Without the need for switching on all of the electronic devices toobtain audio data from the electronic devices, a user may receive theaudio data from all the electronic devices through an earphone connectedto one of the electronic devices, thus preventing other users from beingannoyed by the audio data generated from the electronic devices.

Rather than connecting an earphone to a television or PC, a user mayconnect the earphone to a portable electronic device, such as asmartphone, which is physically or wirelessly connected to the TV or PC,to receive audio data generated from the television or PC.

According to the embodiments, audio data of a particular one of aplurality of electronic devices networked to a corresponding electronicdevice may be pulled and output, the particular electronic device beingassociated with the corresponding electronic device. This may eliminateany inconvenience that causes a user to pull and output unnecessaryaudio data.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments of the present invention will become readily apparent byreference to the following detailed description when considered inconjunction with the accompanying drawings wherein:

FIG. 1 is a block diagram illustrating an electronic device according toan embodiment of the present invention;

FIGS. 2 to 4 illustrate an environment of an electronic device accordingto an embodiment of the present invention;

FIGS. 5 to 8 illustrate an embodiment of the present invention;

FIG. 9 is a flowchart illustrating a method of controlling an electronicdevice according to an embodiment of the present invention;

FIG. 10 illustrates a window inquiring that a user desires to pull inaudio data according to an embodiment of the present invention;

FIGS. 11 to 13 illustrate the type of a predetermined event according toan embodiment of the present invention;

FIGS. 14 to 17 illustrate a method of identifying an electronic deviceoutputting an associated content according to an embodiment of thepresent invention;

FIG. 18 illustrates a delay occurring upon transmission of audio dataaccording to an embodiment of the present invention;

FIG. 19 illustrates a method of recovering sync distortion that mayoccur according to an embodiment of the present invention; and

FIG. 20 illustrates an indicator displayed when audio data istransmitted to other electronic devices according to an embodiment ofthe present invention.

DESCRIPTION OF THE EMBODIMENTS

The embodiments of the present invention will be apparent from thedetailed description with reference to the accompanying drawings.However, the embodiments of the present invention are not limitedthereto, and diverse variations or modifications to the embodiments maybe made.

In the drawings, the thickness of the layer or region may be exaggeratedfor clarity. It will be understood that when an element or layer isreferred to as being “on” another element or layer, it can be directlyon the other element or layer or intervening elements or layers may bepresent. Like numbers may refer to like or similar elements throughoutthe specification and the drawings.

When determined to render the gist of the present inventionunnecessarily unclear, the specific description on known functions orconfigurations will be omitted. As used herein, the number (for example,first, second, . . . ) is used only to distinguish one component fromanother.

In the following description, suffixes “module” and “unit” are given tocomponents of the mobile terminal in consideration of only facilitationof description and do not have meanings or functions discriminated fromeach other.

As used herein, the electronic device may include a stationary typeterminal, such as a digital TV or a desktop computer, as well as amobile terminal, such as a cellular phone, a smart phone, a laptopcomputer, a digital broadcast terminal, a PDA (Personal DigitalAssistant), a PMP (Portable Multimedia Player), or a navigation system.

FIG. 1 is a block diagram illustrating an electronic device according toan embodiment of the present invention.

The electronic device 100 includes a wireless communication unit 110, anA/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit140, an output unit 150, a memory 160, an interface unit 170, a controlunit 180, and a power supply 190. The components shown in FIG. 1 are notnecessary, and according to an embodiment, more or less components maybe included in the electronic device 100.

Hereinafter, each component is described more specifically.

The wireless communication unit 110 may include one or more modules thatenable wireless communication between the electronic device 100 and awireless communication system or between the electronic device 100 and anetwork in which the electronic device 100 is positioned. For instance,the electronic device 100 may include a broadcast receiving module 111,a mobile communication module 112, a wireless Internet module 113, anear field communication module 114, and a location information module115.

The broadcast receiving module 111 receives broadcast signals and/orbroadcast-related information from an external broadcast managementserver through broadcast channels.

The broadcast channels include satellite channels or terrestrialchannels. The broadcast management server may include a server thatgenerates and transmits broadcast signals and/or broadcast-relatedinformation or receives pre-generated broadcast signals and/orbroadcast-related information and transmits the signals and informationto a terminal. The broadcast signals may include TV broadcast signals,radio broadcast signals, and data broadcast signals, as well asbroadcast signals including combinations of TV broadcast signals orradio broadcast signals and data broadcast signals.

The broadcast-related information may include information relating tobroadcast channels, broadcast programs or broadcast service providers.The broadcast-related information may be provided through a mobilecommunication network and may be received through the mobilecommunication module 112.

Various types of broadcast-related information may be provided, such asEPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting)or ESG (Electronic Service Guide) of DVBH (Digital Video BroadcastHandheld).

The broadcast receiving module 111 receives broadcast signals (e.g.,digital broadcast signals) through various broadcast systems, such as,for example, DMBT (Digital Multimedia Broadcasting Terrestrial), DMBS(Digital Multimedia Broadcasting Satellite), MediaFLO (Media ForwardLink Only), DVBH (Digital Video Broadcast Handheld), ISDBT (IntegratedServices Digital Broadcast Terrestrial), or other digital broadcastsystems. The broadcast receiving module 111 may be configured to fit forany other broadcast system providing broadcast signals as well as theabove-listed digital broadcast systems.

The broadcast signals and/or broadcast-related information receivedthrough the broadcast receiving module 111 may be stored in the memory160.

The mobile communication module 112 transmits and receives wirelesssignals to/from at least one of a base station, an external terminal,and a server over a mobile communication network. The wireless signalsmay include voice call signals, video call signals, various types ofdata based on transmission/reception of text/multimedia messages.

The wireless Internet module 113 may include modules that can access theInternet wirelessly. The wireless Internet module 113 may be providedinside or outside the electronic device 100. Various types of wirelesstechnologies may be used, such as WLAN (Wireless LAN) (WiFi), Wibro(Wireless broadband), Wimax (World Interoperability for MicrowaveAccess), or HSDPA (High Speed Downlink Packet Access).

The near field communication module 114 may include modules fornear-field communication. Various near-field communication technologiesmay be employed, such as Bluetooth, RFID (Radio FrequencyIdentification), IrDA (infrared Data Association), UWB (Ultra Wideband),ZigBee, or WiHD, WiGig.

The location information module 115 may include a module for identifyinga position of the electronic device or for obtaining the information onthe position. A representative example of the location informationmodule 115 includes a GPS (Global Position System) module. The GPSmodule 115 may yield three-dimensional location information based on thelongitude, latitude, and altitude of one position (object) at one timeby obtaining information on distances between the position (object) andthree or more satellites and information on time when the distanceinformation is obtained followed by triangulation. Further, the locationinformation module 115 may obtain information on the position and timeusing three satellites and correct the obtained information usinganother satellite. The location information module 115 may produce thecurrent position in real time and calculate the speed information usingthe current position.

Referring to FIG. 1, the A/V input unit 120 may include a camera 121 anda microphone 122 to receive audio or video signals. The camera 121processes picture frames such as still images or video images obtainedby an image sensor in a video call mode or image capturing mode. Theprocessed picture frames may be displayed on the display unit 151.

The picture frames processed by the camera 121 may be stored in thememory 160 or externally transmitted through the wireless communicationunit 110. Two or more cameras 121 may be provided depending onconfiguration of the terminal.

The microphone 122 receives external sound signals in a call mode,recording mode, or voice recognition mode and processes the receivedsignals into electrical sound data. In the case of the call mode, thesound data may be converted into transmittable form and output to amobile base station through the mobile communication module 112. Themicrophone 122 may include various noise cancelling algorithms toeliminate noise that is created while receiving external sound signals.

The user input unit 130 generates input data for a user to control theoperation of the terminal. The user input unit 130 may include a keypad, a dome switch, a touch pad (resistive/capacitive), jog wheel, or ajog switch.

The sensing unit 140 may sense the current state of the electronicdevice 100, such as the opening/closing state of the electronic device100, position of the electronic device 100, presence or absence ofuser's contact, orientation of the electronic device 100, oracceleration/deceleration of the electronic device 100 and generatessensing signals for controlling the operation of the electronic device100. For instance, in the case that the electronic device 100 is asliding phone, the sensing unit 140 may sense whether to open or closethe sliding phone. Further, the sensing unit 140 may also sense whetherthe power supply 190 supplies power or whether the interface unit 170 iscoupled with an external device. The sensing unit 140 may include aposture sensor 141 and/or proximity sensor 142.

The output unit 150 is provided to generate visual, audible, or tactileoutputs. The output unit 150 may include a display unit 151, a soundoutput module 152, an alarm unit 153, and a haptic module 154.

The display unit 151 displays information processed by the electronicdevice 100. For example, in the case that the electronic device 100 issubjected to the call mode, the display unit 151 displays a UI (UserInterface) or GUI (Graphic User Interface) relating to call. In the casethat the electronic device 100 is in the video call mode or imagecapturing mode, the display unit 151 displays captured and/or receivedimages or UIs or GUIs.

The display unit 151 may include at least one of a liquid crystaldisplay, a thin film transistor liquid crystal display, an organic lightemitting diode display, a flexible display, or a 3D display.

The display unit 151 may be configured in a transparent or lighttransmissive type, which may be called a “transparent display” examplesof which include transparent LCDs. The display unit 151 may have alight-transmissive rear structure in which a user may view an objectpositioned behind the terminal body through an area occupied by thedisplay unit 151 in the terminal body.

According to an embodiment, two or more display units 151 may beincluded in the electronic device 100. For instance, the electronicdevice 100 may include a plurality of display units 151 that areintegrally or separately arranged on a surface of the electronic device100 or on respective different surfaces of the electronic device 100.

The display unit 151 may be logically divided into two or more regions.

When the display unit 151 and a sensor sensing a touch (hereinafter,referred to as a “touch sensor”) are layered (this layered structure ishereinafter referred to as a “touch sensor”), the display unit 151 maybe used as an input device as well as an output device. The touch sensormay include, for example, a touch film, a touch sheet, or a touch pad.

The touch sensor may be configured to convert a change in pressure orcapacitance, which occurs at a certain area of the display unit 151,into an electrical input signal. The touch sensor may be configured todetect the pressure exerted during a touch as well as the position orarea of the touch.

Upon touch on the touch sensor, a corresponding signal is transferred toa touch controller. The touch controller processes the signal togenerate corresponding data and transmits the data to the control unit180. By doing so, the control unit 180 may recognize the area of thedisplay unit 151 where the touch occurred.

The proximity sensor 142 may be positioned in an inner area of theelectronic device 100, which is surrounded by the touch screen, or nearthe touch screen. The proximity sensor 142 refers to a sensor thatdetects an object approaching a predetermined detection surface orpresent near the detection surface without physical contact usingelectromagnetic fields or infrared beams. The proximity sensor 142 haslonger lifespan than a contact-type sensor and has more availability.

The proximity sensor 142 may include, but not limited to, a transmissiveopto-electrical sensor, a direct reflective opto-electrical sensor, amirror reflective opto-electrical sensor, a high frequency oscillatingproximity sensor, a capacitive proximity sensor, a magnetic proximitysensor, or an IR proximity sensor.

If the touch screen is of a capacitive type, the proximity sensor 142may detect the approach of a pointer depending on a variation of anelectric field that occurs as the point gets close. The touch screen(touch sensor) may be classified as the proximity sensor.

Hereinafter, for ease of description, when a point is positioned nearthe touch screen while not in contact with the touch screen and it maybe recognized that the point is positioned on the touch screen, it isrepresented as “proximity touch”. When the point actually contacts thetouch screen, it is represented as “contact touch”. The position wherethe proximity touch to the point is done on the touch screen refers to aposition where the pointer vertically corresponds to the touch screenwhen the pointer is subjected to the proximity touch. However, when theproximity touch need not be distinguished from the contact touch, the“touch” or “touch input” may refer to either an input by the proximitytouch or an input by the contact touch.

The proximity sensor 142 senses a proximity touch and proximity touchpattern (for example, distance, direction, speed, time, position, ortravelling state of the proximity touch). Information corresponding tothe sensed proximity touch operation and proximity touch pattern may bedisplayed on the touch screen.

The sound output module 152 may output audio data received from thewireless communication unit 110 in a call signal receiving mode, callmode, or recording mode, voice recognition mode, or broadcast receivingmode or stored in the memory 160. The sound output module 152 outputssound signals relating to functions performed in the electronic device100 (for example, signaling call signal reception or message reception).The sound output module 152 may include a receiver, a speaker, or abuzzer.

The alarm unit 153 outputs signals for signaling an event occurring inthe electronic device 100. The event may include reception of callsignals or messages, entry of key signals, or touch input. The alarmunit 153 may also output signals for signaling occurrence of an event,for example, by vibration which is of other types than video or audiosignals. The video or audio signals may be output through the displayunit 151 or the sound output module 152.

The haptic module 154 generates various tactile effects that may besensed by a user. A representative example of a tactile effect generatedby the haptic module 154 includes vibration. The strength or pattern ofvibration generated by the haptic module 154 may be controlled. Forexample, different types of vibration may be mixed and output orsequentially output.

The haptic module 154 may generate an effect coming from a stimulus madeby a pin array moving perpendicular to the contact skin surface, aneffect coming from a stimulus by jet or suction force of air through aninlet or suction port, an effect coming from a stimulus created when askin surface is rubbed, an effect coming from a stimulus made by contactwith an electrode, an effect coming from a stimulus by an electrostaticforce, or an effect coming from reproduction of warm or cool feelingusing a heat absorption or generation element.

The haptic module 154 may transfer the tactile effects through a directcontact and may be configured to provide tactile effects through musclesense of a user's finger or arm. Two or more haptic modules 154 may beprovided depending on configuration of the electronic device 100.

The memory 160 may store a program for operation of the control unit 180and may temporarily store input/output data (for example, phone books,messages, still images, or videos). The memory 160 may store datarelating to various patterns of vibration and sounds that are outputwhen touch input is made on the touch screen.

The memory 160 may include at least one storage medium of flash memorytypes, hard disk types, multimedia card micro types, card type memories(e.g., SD or XD memories), RAMs (Random Access Memories), SRAM (StaticRandom Access Memories), ROMs (Read-Only Memories), EEPROMs(Electrically Erasable Programmable Read-Only Memories), PROM(Programmable Read-Only Memories), magnetic memories, magnetic discs,and optical discs. The electronic device 100 may operate in associationwith a web storage performing a storage function of the memory 160 overthe Internet.

The interface unit 170 functions as a path between the electronic device100 and any external device connected to the electronic device 100. Theinterface unit 170 receives data or power from an external device andtransfers the data or power to each component of the electronic device100 or enables data to be transferred from the electronic device 100 tothe external device. For instance, the interface unit 170 may include awired/wireless headset port, an external recharger port, awired/wireless data port, a memory card port, a port connecting a devicehaving an identification module, an audio I/O (Input/Output) port, avideo I/O port, and an earphone port.

The identity module is a chip storing various types of information toauthenticate the authority for using the electronic device 100 and mayinclude a user identity module (UIM), a subscriber identity module(SIM), a universal subscriber identity module (USIM), or the like. Adevice having the identity module (hereinafter, “identity device”) maybe implemented as a smart card so that the identity device may beconnected to the electronic device 100 through a port.

The interface unit may serve as a path through which power is suppliedfrom an external cradle to the electronic device 100 when the cradle isconnected to the electronic device 100 or a path through which variouscommand signals are supplied from the cradle to the electronic device100 by a user. The various command signals and he power from the cradlemay function as signals that allow the user to notice that theelectronic device 100 is correctly coupled with the cradle.

The control unit 180 controls the overall operation of the electronicdevice 100. For example, the control unit 180 performs control andprocess relating to voice call, data communication, or video call. Thecontrol unit 180 may include a multimedia module 181 for playingmultimedia. The multimedia module 181 may be implemented in the controlunit 180 or may be provided separately from the control unit 180.

The control unit 180 may perform pattern recognition process that allowshandwriting or drawing on the touch screen to be recognized as text orimages.

The power supply 190 receives external/internal power under the controlof the control unit 180 and feeds the power to other components.

The embodiments herein may be implemented in software, hardware, or acombination thereof, and may be recorded in a recording medium that maybe read b a computer or its similar device.

When implemented in hardware, the embodiments may be implemented as atleast one of ASICs (application specific integrated circuits), DSPs(digital signal processors), DSPDs (digital signal processing devices),PLDs (programmable logic devices), FPGAs (field programmable gatearrays, processors, controllers, microcontrollers, microprocessors, orelectrical units for performing the functions.

When implemented in software, the processes, functions, or theembodiments may be implemented together with a separate software modulethat may perform at least one function or operation. The software codemay be implemented as a software application that has been written inproper program language. The software code may be stored in the memory160 and executed by the control unit 180.

An environment where an electronic device applies according to anembodiment of the present invention is now described.

FIGS. 2 to 4 illustrate an environment where an electronic deviceapplies according to an embodiment of the present invention. Forconvenience of description, the terms “first electronic device”, “secondelectronic device”, and/or “third electronic device” may be used, eachof which may include the same or substantially the same configuration asthe electronic device 100 described in connection with FIG. 1. Accordingto an embodiment, each of the first to third electronic devices mayinclude more or less components than the components of the electronicdevice 100 illustrated in FIG. 1.

Referring to FIG. 2, electronic devices 100A, 100B, and 100C may bedirectly connected to each other. For example, the first electronicdevice 100A may be directly connected to the second or third electronicdevices 100B and 100C, and the second electronic device 100B may bedirectly connected to the third electronic device 100C.

The connections between the electronic devices 100A, 100B, and 100C maybe made physically or wirelessly. For example, a wired LAN or USB cablemay be used for connection between the electronic devices 100A, 100B,and 100C. Also, wireless interfaces, such as WiFi, WiGig, WiHD, orZigBee, may be used for such connection. As shown in FIG. 2, when theelectronic devices 100A, 100B, and 100C are directly connected to eachother, at least one of the devices 100A, 100B, and 100C may function asa network manager that manages a network established by the devices100A, 100B, and 100C.

Referring to FIG. 3, the electronic devices 100A, 100B, and 100C may beconnected to each other via a server 200. For example, the firstelectronic device 100A is indirectly connected to the electronic devices100A and 100B through the server 200, and the second electronic device100B is indirectly connected to the third electronic device 100C throughthe server 200.

Connection between the server and the electronic devices 100A, 100B, and100C may be made physically or wirelessly as shown in FIG. 2. As shownin FIG. 3, when the electronic devices 100A, 100B, and 100C areconnected to each other via the server 200, the server 200 may functionas a network manager that manages a network established by theelectronic devices 100A, 100B, and 100C.

Referring to FIG. 4, the electronic devices 100A, 100B, and 100C may beconnected to a remote server 300 via a wired/wireless communicationnetwork that is established for remote communication, so that the firstelectronic device 100A may be indirectly connected to the second andthird electronic devices 100B and 100C, and the second electronic device100B may be indirectly connected to the third electronic device 100C.The electronic devices 100A, 100B, and 100C and the server 300 may beconnected to each other through the Internet, a mobile network, or otherknown communication networks.

Although three electronic devices 100A, 100B, and 100C are connected toeach other as shown in FIGS. 2 to 4, the embodiments of the presentinvention are not limited thereto. According to an embodiment, two, orfour or more electronic devices may be connected to each other.

According to an embodiment, when a predetermined event occurs whileaudio data is played through the sound output module 152 of each of theelectronic device 100A, 100B, or 100C connected to each other, one ofthe electronic devices 100A, 100B, and 100C is selected (hereinafter,the selected one is referred to as “selected device” or “selectedelectronic device”) and the selected device pulls in audio datagenerated from the other electronic devices (which are also referred toas “relating devices” or “relating electronic devices”) outputtingcontent associated with content being output through the selecteddevice.

Accordingly, the selected electronic device may output the audio datareceived from the relating devices as well as the audio data generatedfrom the selected electronic device.

When the predetermined event occurs, the relating devices may stopoutputting the audio data associated with the relating devices throughthe external sound output device connected to the relating devicesand/or the sound output modules 152 of the relating devices and maytransmit the audio data generated from the relating devices to theselected device.

FIGS. 5 to 8 illustrate an embodiment of the present invention.Referring to FIG. 5, the second electronic device 100B (hereinafter,assume that the second electronic device 100B is a PC) outputs a soundSB corresponding to second audio data AD2 generated from the secondelectronic device 100B, and the third electronic device 100C(hereinafter, assume that the third electronic device 100C is atelevision) outputs a sound SC corresponding to audio data generatedfrom the third electronic device 100C.

In particular, the second electronic device 100B visually outputs afirst content stored in the memory 160 of the second electronic device100B through the display module 151 or audibly outputs the first contentthrough the sound output module 152, and the third electronic device100C visually outputs a second content transmitted from a broadcaststation 500 as a broadcast signal through the display module 151 oraudibly outputs the second content through the sound output module 152.

As shown in FIG. 6, the first electronic device 100A may establish aconnection with the second electronic device 100B and/or the thirdelectronic device 100C (hereinafter, assume that the third electronicdevice 100C is a smartphone). Similar to the above-described secondelectronic device 100B and/or third electronic device 100C, the firstelectronic device 100A may also output the sound SA corresponding to thefirst audio data AD1 associated with the first electronic device 100Athrough the sound output module 152 of the first electronic device 100A.

Under the situation illustrated in FIG. 6, in response to a user'srequest and/or the operation of a system and/or application of the firstelectronic device 100A, the first electronic device 100A, as shown inFIG. 7, may visually output through the display module 151 a thirdcontent associated with the second content or the first content or mayaudibly output through the sound output module 152 the third content.For example, the third content may be metadata associated with thesecond content being output through the third electronic device 100C.

The “metadata” may have a wide meaning. As used herein, the “metadatafor a particular content” refers to information describing the specificcontent and/or a diversity of visual and/or audible objects included inthe specific content. As illustrated in FIG. 7, when the second contentbeing output through the third electronic device 100C is a movie,Gladiator, the third content output through the first electronic device100A may include information on the title, director, or actors of thesecond content. Further, the third content may include information onthe soundtrack included in the second content, information on the placebeing visually displayed by the second content, or information onproducts being visually displayed by the second content.

As shown in FIG. 7, when the predetermined event occurs in the firstelectronic device 100A while the electronic devices 100A, 100B, and 100Crespectively output the first to third contents, the third electronicdevice 100C outputting the second content associated with the thirdcontent being output through the first electronic device 100A maytransmit the third audio data AD3 associated with the third electronicdevice 100C to the first electronic device 100A as shown in FIG. 8, andthe first electronic device 100A may output the transmitted third audiodata AD3 through the sound output module 152 of the first electronicdevice 100A and/or the external sound output device connected to thefirst electronic device 100A.

The predetermined event may be one of various events. For example, thepredetermined event may include a connection of an external sound outputdevice or a user's request through key entry or touching.

FIG. 8 illustrates an example where the predetermined event isconnection of an external sound output device. For example, after theexternal sound output device 400 is connected to the first electronicdevice 100A, the third audio data AD3 generated from the thirdelectronic device 100C outputting the second content associated with thethird content is transmitted from the third electronic device 100C tothe first electronic device 100A, and the first electronic device 100Amay output the third sound SC corresponding to the third audio data AD3through the external sound output device 400.

The external sound output device may be any type of device, such as anearphone, speaker, or Bluetooth headset, which may audibly transfersounds to a user.

As used herein, the “audio data generated from electronic device(s)”collectively refers to overall audio data to be output through the soundoutput module(s) 152 of the electronic device(s) and/or sound outputdevice(s) connected to the electronic device(s) by a system of theelectronic device(s) and/or an application executed in the electronicdevice(s). For example, the audio data includes audio data (systemalarm/alert sound, etc.) generated by the operation of the system of theelectronic device or audio data (sound of content played by anapplication, such as media player, or message receipt sound output by amessage application) generated by the operation of an application inexecution by the electronic device. The “audio data generated fromelectronic device(s)” may be also referred to as “audio data associatedwith electronic device(s)”.

As used herein, the phrase “output audio data” refers to externallyoutputting a sound corresponding to sound data stored in an analog ordigital format through the sound output module 152 of the electronicdevice and/or a sound output device connected to the electronic deviceso that the sound can be audibly recognized.

FIG. 9 is a flowchart illustrating a method of controlling an electronicdevice according to an embodiment of the present invention. Referring toFIG. 9, the first electronic device 100A is connected to the secondelectronic device 100B and/or the third electronic device 100C (S100).As described in connection with FIGS. 2 to 4, various methods ofconnecting the first electronic device 100A to the devices 100B and/or100C may be adopted.

Before or after the connection formation in step S100, the secondelectronic device 100B and the third electronic device 100C respectivelymay be outputting the first content and the second content (S110).

Subsequently, the first electronic device 100A may output the thirdcontent (S120). The third content may be associated with the first orsecond content. For example, the third content may be metadata for thefirst content or metadata for the second content.

Subsequently, the first electronic device 100A may sense a connectionbetween the first electronic device 100A and an external sound outputdevice 400 (S130). The first electronic device 100A may sense suchconnection by various methods.

When an earphone and/or speaker are connected through an output port ofan electronic device to the electronic device, the electronic device maydetect the connection to the earphone and/or speaker via the outputport. For example, the moment the earphone and/or speaker is connectedto the output port, an interrupt occurs which causes audio datagenerated from the electronic device to be output through the earphoneand/or speaker connected to the output port. The first electronic device100A may sense connection of the external sound output device 400 basedon occurrence of an interrupt (S130).

For example, a Bluetooth technology may be used for wireless connectionwith the external sound output device. In the Bluetooth technology, theoperation of an electronic device attempting to connect with a soundoutput device is called “pairing” through which the electronic devicemay identify the type of the sound output device connected to theelectronic device. For example, an electronic device may obtaininformation on whether another electronic device connected to theelectronic device based on a Bluetooth technology is a desktop computer,a mobile terminal, such as a smartphone, or a sound output device, suchas a Bluetooth headset. Accordingly, the first electronic device 100Amay sense connection of the external sound output device 400 based onthe pairing operation (S130).

When sensing the connection of the external sound output device 400, thefirst electronic device 100A may transmit the first message to anelectronic device outputting content associated with the first contentbeing output through the first electronic device 100A (S140). Forexample, when the third content is associated with the first content,the first electronic device 100A may transmit the first message to thesecond electronic device 100B, and when the third content is associatedwith the second content, the first electronic device 100A may transmitthe second message to the third electronic device 100C. For convenienceof description, assume that the third content is associated with thesecond content, and the first message is transmitted to the thirdelectronic device 100C.

According to an embodiment, the first message may simply notify thenon-selected devices 100B and 100C that the external sound output device400 is connected to the first electronic device 100A. Alternatively, thefirst message may include a control signal requesting that thenon-selected devices 100B and 100C send to the first electronic device100A audio data generated after receiving the first message.

Accordingly, after receiving the first message, the third electronicdevice 100C may stop outputting the third audio data AD3 generated fromthe third electronic device 100C through the sound output module 152 ofthe third electronic device 100C (S150) and may transmit the whole thirdaudio data AD3 associated with the third electronic device 100C to thefirst electronic device 100A (S160). For example, without outputting theaudio data corresponding to the second content, the third electronicdevice 100C may transmit the audio data corresponding to the secondcontent to the first electronic device 100A. In addition to the audiodata corresponding to the second content, the audio data associated withthe third electronic device 100C may include audio data generated by theoperation of a system and/or application of the third electronic device100C.

The third audio data AD3 transmitted from the third electronic device100C to the third electronic device 100C is not limited to the audiodata being output through the third electronic device 100C when thefirst message is received and may rather include all types of audio datathat may be generated later from the third electronic device 100C. Forexample, audio data, such as a warning sound and/or user alarming soundgenerated by the operation of a system and/or application of the thirdelectronic device 100C after the reception of the first message may alsobe transmitted to the first electronic device 100A.

When the third content is associated with the second content, the secondelectronic device 100B outputting the first content not associated withthe third content does not receive the first message and accordinglycontinues to perform the operation without any influence. For example,without any control signal based on the operation of a system and/orapplication or entry of a user's request, the second electronic device100B could continue to output the first content.

The audio data transmitted from the third electronic device 100C may beencoded audio data. Since the encoded audio data remains furthercompressed by a data compressing technology compared to when the data isdecoded, data size deceases, thus resulting in more efficient datatransmission. Unlike the general sound output devices, the thirdelectronic device 100C can generally decode the encoded audio data onits own. Accordingly, transmission of such encoded audio data does notcause any technical problems. However, the transmitted audio data is notinevitably limited to the encoded audio data.

When receiving the third audio data AD3 from the third electronic device100C, the first electronic device 100A may output a sound correspondingto the third audio data AD3 through a sound output device connected tothe first electronic device 100A so that a user may audibly notice thesound (S170). For example, the sound SC corresponding to the third audiodata AD3 transmitted from the third electronic device 100C may be outputthrough the external sound output device 400 (e.g., an earphone)connected to the first electronic device 100A so that the sound may beaudibly recognized by the user U.

When the third audio data AD3 is compressed (or encoded) digital audiodata, the first electronic device 100A may decompress (or decode) thethird audio data AD3 so that the audio data AD3 may be normally outputthrough the external sound output device 400.

Rather than outputting only the sound corresponding to the third audiodata AD3, the first electronic device 100A may also output a soundcorresponding to the first audio data AD1 associated with the firstelectronic device 100A.

According to an embodiment, when the external sound output device 400 isconnected to the first electronic device 100A, the first electronicdevice 100A, as described above, may transmit the first message to thethird electronic device 100C. Or the first electronic device 100A mayidentify that the third electronic device 100C is outputting contentassociated with the third content and may then provide a windowinquiring whether the user pulls in the audio data of the thirdelectronic device 100C or not, so that the transmission of the firstmessage is conducted only when the user confirms the pulling of theaudio data.

For example, as shown in FIG. 10, which illustrates a window asking theuser whether he pulls the audio data, after step S130 and before S140, awindow W1 may pop up so that the user selects whether to perform thepulling function for the audio data.

When the first electronic device 100A is disconnected from the externalsound output device 400 while the audio data AD1 and AD3 associated withthe first and third electronic devices 100A and 100C is output throughthe external sound output device 400 connected to the first electronicdevice 100A, e.g., under the control of the first electronic device 100A(S180), the first electronic device 100A may transmit a second messageto the third electronic device 100C (S190).

The second message may simply notify the third electronic device 100Cthat the external sound output device 400 is disconnected from the firstelectronic device 100A. The second message may include a control signalrequesting that the third electronic device 100C output audio datagenerated after receiving the second message through the sound outputmodule 152 of the third electronic device 100C.

Accordingly, the first to third electronic devices 100A, 100B, and 100Creturn to step S110 and/or S120 so that the first to third electronicdevices 100A, 100B, and 100C respectively output the first audio dataAD1 associated with the first electronic device 100A, the second audiodata AD2 associated with the second electronic device, and the thirdaudio data AD3 associated with the third electronic device.

A user who simultaneously uses a plurality of electronic devices (forexample, the smartphone and TV shown in FIGS. 5 to 8) may easily obtainthe audio data associated with the plurality of electronic devicesthrough a sound output device (e.g., earphone) connected to oneelectronic device (e.g., the smartphone shown in FIGS. 5 to 8).

Without the need for switching on all of the electronic devices toobtain audio data from the electronic devices, a user may receive theaudio data from all the electronic devices through an earphone connectedto one of the electronic devices, thus preventing other users from beingannoyed by the audio data generated from the electronic devices.

Rather than connecting an earphone to a television or PC, a user mayconnect the earphone to a portable electronic device, such as asmartphone, which is physically or wirelessly connected to the TV or PC,to receive audio data generated from the television or PC.

According to the embodiments, audio data of a particular one of aplurality of electronic devices networked to a corresponding electronicdevice may be pulled and output, the particular electronic device beingassociated with the corresponding electronic device. This may eliminateany inconvenience that causes a user to pull and output unnecessaryaudio data.

Other many effects may be achieved according to the embodiments of thepresent invention.

The embodiments are not limited to those described above and may berather modified in various forms. Hereinafter, various modifications tothe above-described embodiments are described.

<Predetermined Event>

First, various types of “predetermined events’ are described. Althoughit has been illustrated in FIG. 9 that the predetermined event isconnection between one electronic device and an external sound outputdevice, the predetermined event is not limited thereto.

Referring to FIGS. 10 to 13 which illustrate the type of a predeterminedevent according to an embodiment of the present invention, thepredetermined event is described below.

For example, among the electronic devices 100A, 100B, and 100C, oneelectronic device may recognize or sense a user's active input and/orits passive state through various user interfaces including a menuinterface, a touch interface, a voice interface, or a motion interface,and may determine that a predetermined event occurs when a sensed resultis identical to a predetermined input value or state value.

For example, when a user uses a menu tree structure provided by anelectronic device to select “pulling function for audio data of otherelectronic devices”, a corresponding electronic device may determinethat a predetermined event occurs.

As another example, as shown in FIG. 11, an electronic device maypredefine a voice command (e.g. pulling audio) designated for “pullingfunction for audio data of other electronic devices,” and when thedesignated voice command is input, may determine that a predeterminedevent occurs.

As still another example, an electronic device may predefine aparticular touch stroke TS corresponding to “pulling function for audiodata of other electronic devices” as shown in FIG. 12, and when thepredetermined touch stroke TS is input, may determine that apredetermined event occurs. Subsequently, for example, as shown in FIG.13, an electronic device may predetermine a motion (e.g., shaking asshown in FIG. 13) corresponding to “pulling function for audio data ofother electronic devices,” and when a user makes the predeterminedmotion with the electronic device, may determine that a predeterminedevent occurs. According to an embodiment, a predetermined event may bedesignated by various methods.

According to an embodiment, the predetermined event may also bedesignated by one or more combinations of the above-described or anyother methods of designating a predetermined event. For example, when auser inputs a voice command, “pulling audio”, to an electronic deviceand then shakes the electronic device, the electronic device maydetermine that a predetermined event occurs. As another example, when auser connects an external sound output device 400 to an electronicdevice and then selects “yes” in response to an inquiry asking “Do youwant to perform a pulling function for audio data of other electronicdevices?” on a confirmation window of the electronic device, theelectronic device may determine that a predetermined event occurs.

As such, when a predetermined occurs in an electronic device, acorresponding electronic device (e.g., the first electronic device) mayidentify other electronic devices associated with outputting content,and the first message may be transmitted to the identified electronicdevices.

<How First Electronic Device Identifies Relating Electronic Device?>

According to an embodiment, an electronic device (e.g., the firstelectronic device) where a predetermined event occurs needs to identifyother electronic devices outputting content associated with the firstcontent being output through the first electronic device 100A among aplurality of electronic devices connected to the first electronic device100A.

FIGS. 14 to 17 illustrate a method of identifying an electronic deviceoutputting the associated content according to an embodiment of thepresent invention. Referring to FIGS. 14 to 17, it is described how thefirst electronic device 100A identifies an electronic device outputtingthe associated content.

First, while viewing through the third electronic device 100C (e.g., aTV) a movie, Gladiator, which is content provided from a broadcaststation, a user may desire to see additional information on the movie(e.g., metadata for the movie) through the first electronic device 100A(e.g., a smartphone).

The metadata may be provided from the broadcast station together withthe movie content.

Under this situation, the user may request, by manipulating the thirdelectronic device 100C, transmission of the metadata for the moviecontent to the first electronic device 100A, or by manipulating thefirst electronic device 100A, reception of the metadata for the moviecontent from the first electronic device 100A (in which case, the firstelectronic device 100A may request that the third electronic device 100Csend the metadata to the third electronic device 100C, and in response,the third electronic device 100C may transmit the metadata to the firstelectronic device 100A)

Regardless of whether the user manipulates the first electronic device100A or the third electronic device 100C to output the metadata for themovie through the first electronic device 100A, under the abovesituation, the first electronic device 100A receives the metadata fromthe third electronic device 100C as shown in FIG. 14.

In such case, the first electronic device 100A is aware that theoutputting content (e.g., the metadata for the broadcast content beingoutput through the third electronic device 100C) is received from thethird electronic device 100C, and may thus identify that an electronicdevice (e.g., the third electronic device 100C) transmitting themetadata to the first electronic device 100A is outputting content(e.g., main data for the metadata) associated with the content (e.g.,the metadata) being output through the first electronic device 100A.

According to an embodiment, when the user may view through the thirdelectronic device 100C (e.g., a TV) the movie “Gladiator” which iscontent provided from the broadcast station, no metadata for the moviemay be transmitted from the broadcast station 500 while accessinformation for accessing the metadata for the movie content may beinstead transmitted from the broadcast station 500. The accessinformation may include at least one of URL information for a server 600that provides the metadata, information for identifying the metadata,information for identifying the movie content, and authenticationinformation for accessing the metadata.

Under this situation, upon request that the third electronic device 100Csends the metadata to the first electronic device 100A, as shown in FIG.15, the third electronic device 100C may transmit the access informationfor the metadata to the first electronic device 100A. Accordingly, thefirst electronic device 100A may access the server 600 to request themetadata for the movie content, so that the server 600 may transmit themetadata to the first electronic device 100A.

When receiving the access information for the content being outputthrough the first electronic device 100A from the third electronicdevice 100C, the first electronic device 100A may determine that thethird electronic device 100C providing the access information isoutputting content (e.g., main data for the metadata) associated withthe content (e.g., the metadata) being output through the firstelectronic device 100A.

In the above two cases, the third electronic device 100C intervenes toreceive the content (e.g., the metadata) being output through the thirdelectronic device 100C. However, without intervention of the thirdelectronic device 100C, the first electronic device 100A may also outputthe content (e.g., the metadata) associated with the content beingoutput through the third electronic device 100C.

When the movie content being output through the third electronic device100C is a broadcast content provided from the broadcast station 500, themetadata for the broadcast content may be provided as a broadcast signalfrom the broadcast station together with the main movie content. Underthis situation, the third electronic device 100C may output the moviecontent obtained through the broadcast signal, and the first electronicdevice 100A may output the metadata associated with the movie content asobtained through the broadcast signal. For example, this situation mayhappen when the user attempts to view the metadata associated with CH Xthrough a smartphone (first electronic device) while watching the moviecontent provided over CH X through a television (third electronicdevice)

In such circumstance, as shown in FIG. 17, the first electronic device100A may transmit the third message including information on contentbeing currently output through the first electronic device 100A to allthe electronic devices connected to the first electronic device 100A toobtain information on an electronic device outputting the contentassociated with the content being output through the first electronicdevice 100A (S200).

Receiving the third message, the other electronic devices may determinerelevancy between the both based on information on content being outputthrough the first electronic device 100A as obtained through the thirdmessage and information on content being output through the otherelectronic devices (S210). An electronic device determined to beassociated with the first electronic device 100A may transmit a responsemessage (fourth message) responding to the third message to the firstelectronic device 100A (S220). For example, when the second electronicdevice 100B and the third electronic device 100C receive the thirdmessage from the first electronic device 100A, either the secondelectronic device 100B or the third electronic device 100C may identifywhether the content being output through the first electronic device100A is associated with the content being output through the secondelectronic device 100B or the third electronic device 100C.

When it is determined that the content being output through the secondelectronic device 100B is not associated with the content being outputthrough the first electronic device 100A, the second electronic device100B does not respond to the third message. When it is determined thatthe content being output through the third electronic device 100C isassociated with the content being output through the first electronicdevice 100A, the third electronic device 100C may transmit a responsemessage in response to the third message. Accordingly, the firstelectronic device 100A may identify an electronic device associated withcontent being output by the first electronic device 100A based on theresponse message responding to the third message.

In the embodiments described in connection with FIGS. 14 to 17, theabove-described examples may similarly apply to when the main contentfor the metadata is stored in a local device as well as when the maincontent is broadcast content.

For example, when a multimedia file stored in a PC (second electronicdevice which is a local device and contains metadata, the secondelectronic device 100B may transmit the metadata for content beingoutput through the second electronic device 100B to the first electronicdevice 100A in response to a request from the first electronic device100A and/or a user. As another example, when content being outputthrough a PC (second electronic device) which is a local device isstreamed from a home server (not shown) which is another local deviceand the home server contains metadata for the content being output, thesecond electronic device 100B may transmit access information on themetadata to the first electronic device 100A in response to a requestfrom a user and/or the first electronic device 100A. By a similar methodto those described above, the first electronic device 100A may identifya relating electronic device even for local content, but not forbroadcast content.

<Solve Sync Problem Between Video and Audio Output Through Earphone ofSecond Electronic Device>

The audio data associated with non-selected electronic devices (e.g.,second and third electronic devices 100B and 100C) is transmitted to aselected electronic device (e.g., the first electronic device 100A), andthe audio data processed by the selected electronic device (e.g., thefirst electronic device 100A) may be output through the external soundoutput device 400 connected to the selected electronic device or thesound output module 152 of the selected electronic device.

According to an embodiment, the audio data associated with the secondelectronic device 100B may be associated with video data that isdisplayed in synchronization with the audio data. For example, in thecase of a movie, audio and video data should be output while associatedand synchronized with each other. When a system generates an alarmingsound and/or warning sound and gives an audible feedback and/or notice(hereinafter, collectively “audible feedback”) to a user or the systemgives the user a visual feedback and/or notice (hereinafter,collectively “visual feedback”) together with the alarming sound and/orwarning sound, the audible feedback and the visual feedback may beoutput while synchronized with each other.

When audio data needed to be output while synchronized with video datais transmitted from the second electronic device 100B to the firstelectronic device 100A and output through the external sound outputdevice 400 connected to the first electronic device 100A, a time ofdisplaying the video data output through the second electronic device100B (hereinafter, “video output time”) may differ from a time ofoutputting the audio data associated with the video data through thefirst electronic device 100A (hereinafter, “audio output time”) sincethere may be a delay for transmission of the audio data to the firstelectronic device 100A.

As a result, the video data output through the second electronic device100B may be unsynchronized with the audio data output through the firstelectronic device 100A. FIG. 18 illustrates a delay created upontransmission of audio data according to an embodiment of the presentinvention. Image (a) of FIG. 18 illustrates audio and video dataassociated with each other.

For purposes of illustration, when audio and video data needed to beoutput while synchronized with each other as shown in image (a) of FIG.18 is generated from the second electronic device 100B (e.g., audio andvideo data associated with the second electronic device 100B), the videodata is output through the second electronic device 100B, and the audiodata is transmitted to the first electronic device 100A and then outputthrough the external sound output device 400 and/or the sound outputmodule 152 of the first electronic device 100A.

Synchronization between the audio and video data may be distorted by atime (D, hereinafter, delay time by transmission) taken for the audiodata to be transmitted to the first electronic device 100A. For example,as shown in image (b) of FIG. 18, audio data may be output the delaytime D by transmission after a time when the video data starts to beoutput.

To establish sync between the video data displayed by the secondelectronic device 100B and the audio data output through the firstelectronic device 100A, the second electronic device 100B may delay atime of displaying the video data by the delay time D by transmission.

A method of obtaining the delay time D by transmission by the secondelectronic device 100B is briefly described. The second electronicdevice 100B may obtain a state of a network connected to the firstelectronic device 100A and a data transmission rate of the network tocalculate a time taken for the audio data to be transmitted to the firstelectronic device 100A.

The second electronic device 100B may keep sensing the state of thenetwork and data transmission rate of the network. According to anembodiment, when receiving the first message, the second electronicdevice 100B may transmit a particular message to the first electronicdevice 100A to identify the state of connection with the firstelectronic device 100A and may receive a response message for theparticular message transmitted from the first electronic device 100A.The second electronic device 100B may calculate the connection stateand/or data transmission rate in consideration with a time oftransmitting the particular message and a time of receiving the responsemessage.

To readjust sync between the video data displayed through the secondelectronic device 100B and the audio data output through the firstelectronic device 100A, the second electronic device 100B may receive apredetermined input from the second electronic device 100B and graduallydelay the time of displaying the video data based on the predeterminedinput.

For example, when a user makes a particular input, the first electronicdevice 100A may output the video data with the video data delayed by apredetermined time interval according to the particular input. When theuser makes the particular input twice, the second electronic device 100Bmay output the video data with the video data delayed by double thepredetermined time interval.

FIG. 19 illustrates a method of recovering a sync distortion accordingto an embodiment of the present invention. Image (a) of FIG. 19illustrates that a sync distortion occurs between video and audio dataaccording to an embodiment. When a user makes a particular input once,the second electronic device 100B may output the video data with thevideo data delayed by a predetermined time interval G (image (b) of FIG.19), and when the user makes the particular input again under the abovesituation (e.g., when the user makes the particular input twice), thesecond electronic device 100B delays further by the time interval G inthe state shown in image (b) of FIG. 19, outputting the video data(image (c) of FIG. 19).

Based on the above-described method, the distorted sync between thevideo and audio data may be recovered. Although it is illustrated inFIG. 19 that the particular input is done two times to recover thedistorted sync, according to an embodiment, the distorted sync may berecovered by making the particular once or three times or more.

<Solve Problem Occurring when Another User Controls TV; e.g., Display ofIndicator>

When audio data associated with the second and/or third electronicdevice 100B and/or 100C is output through the external sound outputdevice 400 connected to the first electronic device 100A, e.g., underthe control of the first electronic device 100A, or the sound outputmodule 152 of the first electronic device 100A, the second electronicdevice 100B and/or the third electronic device 100C may display anindicator which includes a symbol or a combination of symbols toindicate that the audio data associated with the second electronicdevice 100B and/or the third electronic device 100C is being transmittedto the first electronic device 100A.

FIG. 20 illustrates an indicator which is displayed when audio data istransmitted to another electronic device according to an embodiment ofthe present invention. As shown in FIG. 20, the second electronic device100B and/or the third electronic device 100C may display the indicator Sthrough the display module 151 of the second electronic device 100B orthe third electronic device 100C. Referring to FIG. 20, other users mayeasily notice that the audio data associated with the second electronicdevice 100B and/or the third electronic device 100C is being transmittedto “JW's Phone”.

As such, the indicator S allows other users to be able to easily noticetransmission of audio data to other electronic devices.

According to an embodiment, the indicator S may remain displayed whenthe second and/or third electronic device 100B or 100C transmits audiodata to the first electronic device 100A. Alternatively, the indicator Smay be displayed only when a user's control request (e.g., the user'sinput for adjusting sound volume of the second and/or third electronicdevice) occurs on the second and/or third electronic device 100B or100C. For example, when the user performs user's input for adjustment ofsound volume through various user interfaces of the second and/or thirdelectronic device 100B or 100C, the second and/or the third electronicdevice 100B or 100C may display the indicator S only for a predeterminedtime so that other users may notice transmission of the audio data ofthe second and/or third electronic device 100B or 100C.

FIG. 20 illustrates that information is also displayed to indicatetransmission of the audio data of the second and/or third electronicdevice 100B or 100C as well as to allow an electronic device receivingthe audio data to be identified. According to an embodiment, theinformation for identifying an electronic device receiving the audiodata may be excluded from the information that may be provided by theindicator. Alternatively, more information may be included in theinformation that may be provided by the indicator.

<In Case that Content Selected by First Electronic Device Changes fromMetadata to Other Contents>

As described above, according to an embodiment, when the firstelectronic device 100A outputs metadata and the second electronic device100B outputs a main content for the metadata, as the external soundoutput device 400 is connected to the first electronic device 100A,audio data (e.g., a sound corresponding to the main content) associatedwith the second electronic device 100B is transmitted to the firstelectronic device 100A.

According to an embodiment, a user may change contents to be outputthrough the first electronic device 100A from the metadata to othercontents (e.g., metadata for content different from the main content,other main contents, etc.). For example, the output of the metadata bythe first electronic device 100A may be stopped and other contents maystart to be output through the first electronic device 100A.

Under this situation, according to an embodiment, the electronic devicemay be controlled as follows.

First, even when contents to be output through the first electronicdevice 100A change, audio data associated with the second electronicdevice 100B may continue to be pulled and output through a sound outputdevice connected thereto.

Second, it is identified whether there is audio data corresponding tothe changed content. When there is any audio data, the audio data of thesecond electronic device 100B continues to be pulled, and when there isno audio data, the audio data of the second electronic device 100B stopsbeing pulled.

Third, when contents output through the first electronic device 100Achange, the first electronic device 100A may provide a user interfacewhich allows a user to enter whether to continue to pull the audio dataof the second electronic device 100B, and may determine whether tocontinue or stop pulling the audio data depending on the user's entrythrough the user interface.

Finally, the first electronic device 100A may identify whether thechanged content is metadata or not. When the changed content ismetadata, the first electronic device 100A may identify anotherelectronic device outputting the main content associated with thechanged metadata and may pull the audio data of the identifiedelectronic device again. Identifying the other electronic deviceoutputting the main content associated with the changed metadata andpulling the audio data may be conducted by the above-described methods.

In the method of controlling an electronic device according to thepresent invention, each step in each embodiment is not inevitable, andeach embodiment may selectively include the steps therein. The steps ineach embodiment are not necessarily performed in the order describedabove, and for example, a later step may be performed earlier than anearlier step.

The control method may be stored in a computer readable recording mediumin the form of a code or program.

The invention has been explained above with reference to exemplaryembodiments. It will be evident to those skilled in the art that variousmodifications may be made thereto without departing from the broaderspirit and scope of the invention. Further, although the invention hasbeen described in the context its implementation in particularenvironments and for particular applications, those skilled in the artwill recognize that the present invention's usefulness is not limitedthereto and that the invention can be beneficially utilized in anynumber of environments and implementations. The foregoing descriptionand drawings are, accordingly, to be regarded in an illustrative ratherthan a restrictive sense.

1. An electronic device configured to be connected to at least oneexternal electronic device, the electronic device comprising: a displayunit; a communication unit configured to perform data communication withthe at least one external electronic device; an interface unitconfigured to connect to a sound output device; and a controllerconnected to the display unit, the communication unit and the interfaceunit, wherein the controller is configured to: display a first contenton the display unit, wherein the first content is associated with asecond content which is being displayed on a first external electronicdevice of the at least one external electronic device, receive firstaudio data of the second content from the first external electronicdevice, only when the connection of the sound output device to theinterface unit is detected while the electronic device displays thefirst content on the display unit, output the first audio data throughthe sound output device, after receiving the first audio data of thesecond content from the first external electronic device, receive secondaudio data which is generated by the first external electronic device,and output the second audio data through the sound output device,wherein the second audio data is not associated with the second content,and when the displayed first content is changed to a third content whichis not associated with the second content, continue to output the firstaudio data through the sound output device.
 2. The electronic device ofclaim 1, wherein the controller is further configured to identifywhether a fourth audio data corresponding to the third content exist. 3.The electronic device of claim 2, wherein the controller is furtherconfigured to provide a user interface which allows a user to enterwhether to continue to output the first audio data of the second contentof the first external electronic device.
 4. The electronic device ofclaim 1, wherein the controller is further configured to transmit afirst message to the at least one external electronic device, the firstmessage requesting transmission of the first audio data of the secondcontent.
 5. The electronic device of claim 1, wherein the controller isfurther configured to detect the first external electronic device fromthe at least one external electronic device that is displaying thesecond content.
 6. The electronic device of claim 5, wherein thecontroller is further configured to detect the first external electronicdevice from the at least one external electronic device, the firstexternal electronic device streaming the first content.
 7. Theelectronic device of claim 5, wherein the controller is furtherconfigured to determine that the first external electronic device isproviding access information for accessing the first content.
 8. Theelectronic device of claim 5, wherein the controller is furtherconfigured to: transmit a second message to the at least one externalelectronic device, the second message including information on the firstcontent, and upon receiving a response message to the second message,identify the first external electronic device from the at least oneexternal electronic device.
 9. The electronic device of claim 1, whereinthe first content includes metadata for the second content.
 10. Theelectronic device of claim 1, wherein the first audio data includesencoded audio data.
 11. The electronic device of claim 1, wherein, whenthe displaying of the first content associated with the second contentis stopped, the controller is further configured to continue to receivethe first audio data from the first external electronic device and tooutput the first audio data through the sound output device.
 12. Theelectronic device of claim 1, wherein, when the displaying of the firstcontent associated with the second content is stopped, the controller isfurther configured to provide a user interface to determine whether tocontinue to receive the first audio data.
 13. The electronic device ofclaim 1, wherein the controller is further configured to output thirdaudio data together with the first audio data through the sound outputdevice, the third audio data being associated with the electronicdevice.
 14. A method of controlling an electronic device connected to atleast one external electronic device, the method comprising: displaying,on a display unit of the electronic device, a first content, wherein thefirst content is associated with a second content which is beingdisplayed on a first external electronic device of the at least oneexternal electronic device; receiving first audio data of the secondcontent from the first external electronic device, only when theconnection of a sound output device to the electronic device is detectedwhile the electronic device displays the first content on the displayunit; outputting the first audio data through the sound output device;after receiving the first audio data of the second content from thefirst external electronic device, receiving second audio data which isgenerated by the first external electronic device, and outputting thesecond audio data through the sound output device, wherein the secondaudio data is not associated with the second content; and when thedisplayed first content is changed to a third content which is notassociated with the second content, maintaining output of the firstaudio data through the sound output device.
 15. The method of claim 14,further comprising identifying whether a fourth audio data correspondingto the third content exist.
 16. The method of claim 15, furthercomprising providing a user interface which allows a user to enterwhether to continue to output the first audio data of the second contentof the first external electronic device.
 17. The method of claim 14,further comprising detecting the first external electronic device fromthe at least one external electronic device that is displaying thesecond content.
 18. The method of claim 17, wherein the detecting stepincludes detecting the first external electronic device from the atleast one external electronic device, the first external electronicdevice streaming the first content.
 19. The method of claim 17, whereinthe detecting step includes determining that the first externalelectronic device is providing access information for accessing thefirst content.
 20. The method of claim 14, further comprising outputtingthird audio data together with the first audio data, the third audiodata being associated with the electronic device.
 21. The method ofclaim 14, further comprising: transmitting a first message to the atleast one external electronic device, the first message requestingtransmission of the first audio data of the second content.
 22. Themethod of claim 14, wherein the first content includes metadata for thesecond content.
 23. The method of claim 14, wherein the first audio dataincludes encoded audio data.
 24. The method of claim 14, furthercomprising: when the displaying of the first content associated with thesecond content is stopped, continuing to receive the first audio datafrom the first external electronic device, and outputting the firstaudio data through the sound output device.
 25. The method of claim 14,further comprising: when the displaying of the first content associatedwith the second content is stopped, providing a user interface todetermine whether to continue to receive the first audio data.
 26. Themethod of claim 17, further comprising: transmitting a second message tothe at least one external electronic device, the second messageincluding information on the first content, and upon receiving aresponse message to the second message, identifying the first externalelectronic device from the at least one external electronic device.